Elements of Information Theory 2006
نویسندگان
چکیده
Information theory answers two fundamental questions in communication theory: What is the ultimate data compression (answer: the entropy H), and what is the ultimate transmission rate of communication (answer: the channel capacity C). For this reason some consider information theory to be a subset of communication theory. We argue that it is much more. Indeed, it has fundamental contributions to make in statistical physics (thermodynamics), computer science (Kolmogorov complexity or algorithmic complexity), statistical inference (Occam's Razor: "The simplest explanation is best"), and to probability and statistics (error exponents for optimal hypothesis testing and estimation).
منابع مشابه
تاثیر عوامل فرهنگی-رفتاری بر تعامل اعضای هیات علمی با اطَلاعات علمی در اینترنت: یک مطالعه ی موردی
Introduction: Previous studies have paid more attention to the technical aspects of the interaction of users with the web-based scientific information, but somehow ignored the cultural-behavioral elements. This study aimed to identify the effects of cultural-behavioral elements on the interaction of faculty members of Management and Medical Information Science School with web-based scientific i...
متن کاملOn Classification of Bivariate Distributions Based on Mutual Information
Among all measures of independence between random variables, mutual information is the only one that is based on information theory. Mutual information takes into account of all kinds of dependencies between variables, i.e., both the linear and non-linear dependencies. In this paper we have classified some well-known bivariate distributions into two classes of distributions based on their mutua...
متن کاملPragmatic Elements of Rawls’s Theory of Justice
In this article, in order to demonstrate the pragmatic elements of Rawls’s viewpoint, the developmental path of his A Theory of Justice shall first be investigated. This development has two phases: In the first phase, justice has an ethical-philosophical basis. In A Theory of Justice, this phase is specifically shown under the title of theory of justice. In the second phase, justice has no phil...
متن کاملIranian EFL Learners’ Perception of the Efficacy and Affordance of Activity Theory-based Computer Assisted Language Learning in Writing Achievement
Second language writing instruction has been greatly influenced by the growing importance of technology and the recent shift of paradigm from a cognitive to a social orientation in second language acquisition (Lantolf & Thorne, 2006). Therefore, the applications of computer assisted language learning and activity theory have been suggested as a promising framework for writing studies. The prese...
متن کاملمدلسازی پویاییهای سیستم صف با استفاده از رویکرد پویایی سیستم
Queuing theory in a very simple Definition is a branch of mathematics for analysis and management of waiting lines. It is developed in the first years of twentieth century when telephone waiting Lines were studied. Servers are not necessarily human beings but in queuing systems that human Agents are servers, it is possible to consider the queuing system as a dynamic system. This is because in ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009